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Abstract 

We revisit the effect of the large stop mixing on the decay and production of the hghtest SUSY 
Higgs at the LHC. We stress that whenever the inclusive 2-photon signature is substantially re- 
duced, associated production, Wh and tth, with the subsequent decay of the Higgs into photons 
is enhanced and becomes an even more important discovery channel. We also point out that 
these reductions in the inclusive channel do not occur for the smallest Higgs masses where the 
significance is known to be lowest. We show that in such scenarios the Higgs can be produced 
in the decay of the heaviest stop. For not too heavy masses of the pseudo-scalar Higgs where 
the inclusive channel is even further reduced, we show that large stop mixing also allows the 
production of the pseudo-scalar Higgs through stop decays. These large mixing scenarios there- 
fore offer much better prospects than previously thought. As a by-product we have recalculated 
tit\h production at the LHC and give a first evaluation of the iii\Z. 
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1 Introduction 



The most popular alternative to the Standard Model, is supersymmetry which at 

the moment fits in very well with all the precision data. So well in fact that some see 
in the latest precision data as preferring a low Higgs mass a very good evidence for 
SUSY. In fact a low mass for one of the scalar Higgses is the most robust limit of any 
supersymmetric model, contrary to all the other (s)particles of the model which may have 
rather high masses. In the minimal scenario of SUSY, the light Higgs mass can not exceed 
~ 130GeV. Considering the existing LEP2|]l| direct searches which indicate a mass greater 
than about 90GeV means that the lightest SUSY Higgs is confined to a small mass range. 
Yet this range of Higgs masses poses considerable problems for hadron colliders. For a 
review see]^. The dominant decay into bb is not exploitable, especially in the inclusive 
production channel gg ^ h ^ bb, due to the huge QCD background. One therefore 
has to rely on the much smaller two-photon signal]^. However, especially for the LHC, 
the two-photon decay of the light Higgs to which dedicated detectors are being designed 
constitutes a challenge. Moreover many effects either due to the direct @, ^, § or indirect 
(loop) P, 0, H, ^ contributions of the rich SUSY spectrum enter the predictions of the two- 
photon rate of the supersymmetric Higgs. These can lead to a substantial reduction of the 
supersymmetric Higgs signal as compared to the standard model Higgs. Take for instance 
the rather simple scenario |l^ where all sparticles, apart from the parameters of the 
Higgs sector, are very heavy and where mixing effects are negligible. This is the scenario 
which has been extensively investigated by the ATLAS [0, |1^/CMS|13| collaborations 
which leads to the much celebrated — tan/? Higgs discovery potential of the LHC. For 
short, we will refer to this model as Class-H scenario. In this scenario the two-photon 
Higgs signal can be much reduced compared to the SAi Higgs especially as one lowers 
the mass of the pseudo-scalar boson, A^. Nonetheless, even in this scenario, this channel 
covers a large part of the — tan f3 discovery plane, while when Ma gets small so that 
the two-photon signal gets too small, one can extend the discovery potential by exploiting 
the signatures of the then not too heavy additional Higgses |T^, [11], |T2|, ^ . It is therefore 
important to inquire how much the important two-photon signal can get reduced and 
equally important to investigate when this reduction occurs, whether new mechanisms 
for Higgs production open up or are enhanced. Could the latter then make up for the loss 
in the former? 

Considering that a general SUSY model furnishes an almost untractable number of 
parameters to give an unambiguous answer, apart from the Class-H scenario only partial 
investigations]^, ||, |^ within specific models have been conducted. To quantify how the 
rate of the two-photon signal can be affected as the SUSY parameters are varied, it is 



instructive to take as a reference point the signal for a SAi Higgs with a mass that of 



the hghtest SUSY Higgs. In|]^ this has been done within the mSUGRA hypothesis |T4 
but considering only the dominant inclusive Higgs production channel: gg —>■ h ^ 77. 
One does find indeed that this ratio can be much smaller than unity even for relatively 
large (which is generic in mSUGRA) and hence making it more difficult to search for 
the SUSY Higgs than for the same mass SA4 Higgs. However it is known[15| that within 



mSUGRA other channels for Higgs production may open up, like the cascading of the 
heavier neutralino to a lighter one and a Higgs, thus offering the fantastic possibility of not 



only discovering supersymmetry but allowing an easy detection of the Higgs |jT6[ before its 



observation in the two-photon channel. Recently, it has been argued^, that even in the 



large Ma region, the so-called decoupling limit [|T7|, if one introduces large mixing in the 
stop sector a very substantial reduction can also ensue in the inclusive two-photon Higgs 
signal. This effect together with the issue of the mixing in the Higgsinos/gaugino sector 
had been studied previously by comparing the rates with and without mixing [^]. It was 
found that there were small regions in parameter space where the rate for the two-photon 
Higgs signal could be either very much reduced or very much enhanced by the inclusion 
of mixing. 

When large reductions in an important channel occur it is crucial to find out how other 
channels are affected. What has not been stressed in the previous studies]]^, ||, |[, espe- 
cially in the case of large mixing, is the importance of the associated Higgs production |[I8|, 



|T9|, ^ and even if no efficient 6-tagging were possible, how in these scenarios these pro- 
cesses can salvage the Higgs signal. Within the SAi and in the no-mixing scenarios, 
both CMS[^, |l^ and ATLAS p^, [12| have now shown that associated Higgs production 
{Wh, Zh and tih), with the subsequent decay of the Higgs into photons, can provide an 
invaluable Higgs signal, when enough luminosity has been accumulated. This is because, 
although associated production has lower rates than the inclusive channel, the corre- 
sponding signals are not plagued by as much background. The CMS analysis |]13[ for the 
SAi Higgs shows that already with an integrated luminosity of 30/6~^ the 77/ (/ = e, /i) 
leads to a significance higher than 5 (thus an observable Higgs signal) for the range of 
light Higgs masses we are interested in. For a high luminosity of 100/6^^ this significance 
improves to more than 10 and is higher than the significance in the inclusive channel 
for practically all Higgs masses in the range of interest. Although it is known that the 
ATLAS analyses are less optimistic^ when it comes to the two-photon signal, either in 
the associated or inclusive channel [1T2|, it remains that at high luminosity the associated 
production provides a better reach in the — tan (3 plane fl^. One should therefore also 
inquire in the case of the SUSY Higgs if the rates for associated production are reduced 



^The differences between ATLAS and CMS are quantified in psl 



together with the inclusive rates or if they can rather help the discovery potential. At the 
same time if the rates for the SUSY Higgs are very much affected this generally means 
that some sort of non-decoupling of some of the SUSY particles is taking place. These 
particles should then be observed directly. Moreover since their coupling to the Higgs 
can not be negligible, these same particles could trigger Higgs production, through their 
decays for instance or through new associated productions. Another important aspect 
to address is the impact of stop mixing on the Higgs mass and its conjunction with the 
reduction in the inclusive channel. Indeed, the significance in the inclusive two-photon 
channel is very much dependent on the Higgs mass, even in the narrow range allowed by 



SUSY[0, |T3|, contrary to the associated two-photon channel where the significances are 



rather flat as a function of the Higgs mass in the range of interest [13, 12]. 

The present paper revisits the case of the large mixing in the stop sector]^, how 
the Wh/Zh and tth associated production saves the day when the inclusive channel drops 
to critical levels and how other new channels for Higgs production open up. To set the 
stage, section 2 is intended as a reminder of how much a reduction in the usual light 
Higgs signals can occur and is tolerable in the Class-H scenario. This will serve as a 
benchmark when we study whether the other scenarios could give reductions which are 
much worse than those obtained with lowering Ma, a situation of some concern especially 
if no new production mechanism is exploitable. We will also present some approximations 
for evaluating the reductions due to Ma which will be useful even when we study the stop 
mixing case. 

Our analysis of the large mixing scenario in the stop sector is contained in Section 3. 
We first consider the large Ma limit. While we confirm that large reductions in the 
inclusive channel can occur, we point out that in most cases these are no worse than 
what is obtained with a low Ma in the no-mixing case. Moreover we will show that if 
tan/5 > 3 an increase in the inclusive channel is possible. This increase is not possible 
for low values of tan/5 as studied in because the effect is associated with a too low 
Higgs mass already excluded by LEP2. We also carefully analyse for which (light) Higgs 
masses these reductions occur. We will show that contrary to the no-mixing scenario 
where the signals in the inclusive channels are lowest for the lowest Higgs masses, in the 
case of large stop mixing the most drastic drops in the inclusive channels do not occur 
for the lightest Higgs mass possible. Indeed the effect of mixing tends to increase the 
mass of the Higgs compared to its value in the absence of mixing. Considering that the 
significances for the SAi Higgs in the inclusive channel are lowest for the lowest possible 
Higgs masses in our range, ~ 90 — 130GeV, means that the largest reductions do not 
necessarily correspond to the lowest Higgs signal. For instance a reduction of .4 may 
well be tolerated for a Higgs mass of llOGeV but a reduction of .8 may be "too much" 



when it occurs in conjunction with rrih = 90GeV. More importantly we find that at the 
same time as the inclusive channel decreases, the associated production increases and has 
much better significances than with a SAi Higgs or with a corresponding SUSY Higgs 
where the stop mixing have been switched off. We will explain why this is so. It should 
also be pointed out that the large reductions in the inclusive channel occur mostly when 
one of the stops becomes rather light, below about 200GeV. In many instances, as first 



suggested by ||2J], associated titih production can provide a new channel to search for 
the light Higgs. We will quantify how much one can benefit from this additional channel. 
Most studies |0, || have assumed equality of all soft squark masses which almost invariably 
leads to a maximal mixing angle | sin 2% = 1 1 , where 6f: is the mixing angle in the stop 
sector. Maximal mixing should be viewed as a very special singular point in the large 
array of the SUSY parameters and even though justified for the first two families as 



suggested by the mSUGRA[0 scenario is quite unnatural for the third family especially 
in view of the large Yukawa coupling. We show, nonetheless, that maximal mixing is not 
always required for the reductions in the two-photon rates to occur. However, moving 
away even slightly from this singular mixing angle, while not changing much the previous 
conclusions, can open yet another Higgs production channel. We point out that provided 
777,^2 is not too large, say m^^ < SOOGeV, so that its production rate is large, ^2 can 
provide a source of Higgs through its decay into the lighter stop thanks to a sizeable 
Yukawa t2tih coupling. This coupling is controlled by the same parameters that make 
the titih coupling large and which lead to a reduction of the inclusive channel. We will 
compare the rate for this new Higgs production mechanism a{pp —>■ ^2^2 ~^ ^2^1^ + i^^iih) 
with the associated lightest stop pair production mechanism a{pp — tit\h) and show 
that the cascade decay of the ^2 can be substantial. This is akin|jl5| to the mixing in 
the higgsino-gaugino sector which has been shown [p!^] to allow a direct Higgs production 
through the cascade decay x% ^ Xi^ ■ We then move to the analysis of the combined 
effect of allowing for smaller pseudo-scalar masses together with large stop mixing. For 
moderate Ma our conclusions are little changed, the associated productions offering always 
a good channel. When gets rather small [M^ ~ 250GeV), the usual reduction, as 
compared to the SAi, in both the inclusive and associated production occurs. This 
is irrespective of mixing and can be explained along the lines of what happens in the 
Class-H scenario. Including the large mixing effects from the stops could decrease even 
further the signal from the inclusive channel, but the same effect again helps increase the 
associated production channel. Therefore the reach in this channel alone is better than 
what previously studied by ATLAS ]T^, |TT| and CMS||T^ in the — tan/3 plane for the 



no-mixing Class-H scenario. Luckily in these situations with both a low and large 
mixings in the stop sector we find that beside the new channels for Higgs (h) production 
a{pp ^2^2 — ^ t2tih) and a{j)p tit\h)^ one can also have a{j)p t2t2 — > t2tiA). There 



are even instances where the pseudo-scalar Higgs triggers h production through A Zh. 
Independently of the extreme mixing scenario studied here we advocate to exploit the 
potentially large Yukawa coupling of the stops to search for the Higgs(es) through the 
cascade decays of these third generation squarks. In all our discussion we do not mention 
rescuing the Higgs signal through its decay into bb in the associated production which 



would be possible provided good 6-tagging is available as discussed by ATLAS ||2^, [12 



This is a difficult issue ||2^ especially at high luminosity and further simulation studies 



are needed. Section 4 gives our conclusions. 

2 A warm up: Variation with Ma in the case of no 
mixing 

In order to compare the various effects of lowering the masses of the SUSY particles, we 
start by briefly reviewing the situation when the masses of all sparticles but those of the 
Higgs sector are set to a high scale, Ms = ITeV. The mass of the pseudo-scalar Higgs 
is let free. Moreover in the illustration we have also taken the Higgs mixing parameter 
such that fi = — ISOGeV^ and the SU{2) gaugino mass M2 = SOOGeV with the traditional 
GUT assumption on the gaugino masses which at the electroweak translates as 

5 

Mi = -tan^9wM2 (2.1) 
3 

Therefore strictly speaking we have allowed rather light charginos and neutralinos. All 



the tri-linear A-terms were set to zero. These kind of scenarios^, [T^, |ri|, [13], with high 
masses of sfermions, have been assumed in the simulation searches for the Higgs(es) by the 
ATLAS/CMS Collaboration leading to the much advertised M^ — tan/5 plots. Meanwhile 



it has been known for some time that as Ma increases one reaches a decoupling regime |T7 



whereby at low energy only the lightest neutral Higgs appears in the spectrum with the 
important property that its couplings are essentially the same as those of the standard 
model. This kind of 5A1-like Higgs should be easiest to discover at the LHC However 
as the mass of the pseudoscalar decreases the production rates of the lightest Higgs also 
decrease. The reduction in the inclusive two-photon rate of the Higgs, as compared to 
the SM., is defined through the ratio 



_ r^^^^(/^ ^ gg) X BR'^'^jh -> 77) 



r^^{h gg) X BR3^'^{h 77) 



This ratio is calculated by taking the same mass for the SAi Higgs as the one that 
is derived for the SUSY Higgs once all the SUSY parameters are set. Throughout this 



paper we use HDECAY[^] to calculate all the couplings, widths and branching ratios of the 
Higgs. This program incorporates the leading two-loop corrections for the Higgs masses 
following [p9|]. We show in Fig. |1] how this ratio decreases with M4. This ratio can drop 
to as little as ~ 30% for = 200GeV and tan (3 = 10. Though trivial in this case, it is 
useful to point for later that as the pseudo-scalar Higgs mass decreases so do the other 
Higgs masses^, therefore the most drastic drops occur for the lowest range of the lightest 
Higgs, see Fig. ^ This is particularly drastic for tan/3 = 2.5GeV, where the drop occurs 
around m/j ~ 90GeV. It is for these low masses that the significance of the SAi Higgs is 
also lowest ITTl, and therefore for this low tan j3 this would constitute the worst scenario 
for the discovery of the lightest SUSY Higgs through its two-photon decayfj. 
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Figure 1: Variation of Rgg^^ with Ma, for tan/3 = 2.5 (full) and tan/? = 10 (dotted) 



What is troublesome for a low is that the branching fraction into two photons is 
the main reason behind the drop, as shown in Fig. ^ This ratio is defined as 



For instance for Ma = 200GeV and tan/3 = 2.5, the ratio of the branching fraction into 
photons, R^^, is reduced to about .5 with respect to what it would be in the SJ^ . This 
reduction accounts for much of the reduction in Rgg^^, Rgg-y-y = -4. Therefore one expects 
also a considerable drop in the Higgs signal even in the associated channel Wh and tth 
with the subsequent decay of the Higgs into two photons. These channels have been shown 
to be invaluable [p^, pJ] , 0, especially when a high luminosity has been accumulated. 
•^In the analysis we have required Mh > 90GeV. 

''Of course, for Ma < 2mt there is a chance of discovering the other Higgses. 




Figure 2: a) Rgg-y-y vs as Ma varies from 200GeV to lOOOGeV for different values of 
tan/5, /i = —ISOGeV. The lowest values of Rgg^^ and R^^ correspond to Ma = 200GeV. 

b ^ t^gg^yy US f^ryy • 



To get an understanding of these gross features and compare with what happens in 
other scenarios, it is worth discussing how the various couphngs, tih, bbh and Wh/Zh 
that enter both the associated production and, at the loop level, the inclusive production 
are influenced by a change in Ma- This is best illustrated and most transparent in the 
large Ma, so-called decoupling, limit which has been shown to be already operative at 



200GeV 17 . Take the tth coupling which differs from the SAi by the factor R: 



Vt 



9 



tth 



-R nit with R 



cos a 



(2.4) 



2Mw ' " sin/? 

where a is the usual angle that appears in the diagonalization of the CP-even neutral 
Higgs mass matrix. As was shown elsewhere ||30|, pi]], in this limit and up to radiative 



corrections we may introduce the factor r 



tanatan^ = -(1 + r) with r < 1 (2.5) 

where r collects all Ma dependence and other radiative corrections which also occur in 
the computation of the Higgs masses. Neglecting the latter we have 

2Ml tan^ 3-1 , , 

r ^ — f — - > 2.6 

Ml tan^ (3 + 1 - ^ ^ 

then the reduction factor which appears in tth is 

^2 ^ l+tan^(3 ^ ^ 1 _ ^ (2 7) 

1 + tan^ /5 + r2 + 2r 1 + tan^ (3 ^ ' ' 

Likewise it is found that in hbb there is an enhancement factor which especially, for 
larger values of tan (3, is more substantial than the reduction in the top vertex 

tan^ 8 

On the other hand the WWh/ZZh vertex, controlled by sin (a — (3), is much less 
affected: it only shows a quadratic dependence in r: 

„ tan^/9 

In the SA4 r{h ^ 77) is dominated by the W loop which interferes destructively with 
the top. Since, in this scenario the dominant W coupling is hardly affected at moderate 
M4 the little change in the top (bottom) coupling has negligible effect on r{h '-ff). 
However this is not the case for the branching fraction into photons. Here, since the total 
width is dominated by the width into bb, which is larger than in the SAi, the branching 
ratio into photons will be reduced, especially as tan (3 increases, see Eq. |2.8| . On the other 
hand we expect a slight decrease in the r{h ^ gg). This is because it is dominated by 
the top loop in the SAi, and therefore it is reduced roughly as the tih vertex is reduced. 
Therefore the main effect in the production rate /i — > 77 is due to the reduction 

in Br{h — > 77). This very crude argument gives the correct order of magnitude in the 
different drops in Rgg-y-y and R.yy shown in the figures. Writing for example 

rs^^(h^bb) ^ 4M|tan^/3(tan^/3-l) 
" TSUSY^h ^bb)~ Ml (1 + tan2/5)2 ^^'''^^ 

we recover R^^ = .483 for Ma = 200GeV and tan/3 = 2.5 which compares very well 
with the full calculation. Moreover in a first approximation, the change in the width into 



gluons can be mostly accounted for by the change in the tth vertex. In which case we 
may write 

4M| tan^ (3 - 1 

^9977 - - Ml l + tan2/? ^ ' 

For larger tan (3 and especially for low values of Ma the approximation is acceptable 
but not as good. This is partly due to the effect of radiative corrections on the h ^ bb 
coupling through the diagonalisation of the neutral Higgs mass matrice^. Especially for 
large tan (3 these corrections are no longer so suppressed compared to the M\ corrections 
|3^, |3l|, |3^. In our case the effect is rather marginal since the only mixing parameter, /z, 



is rather small compared to the SUSY scale. However let us stress that in all the analyses 
in this paper even when considering large values of the tri-linear coupling (see next section) 
the branching ratio into bb is hardly affected. Because our aim is to concentrate on the 
effect of the tri-linear coupling of the top sector we do not, in the present paper, analyse 
the case with very large tan/5 as these would require to analyse the sbottom sector and 
also for large /i possible reductions in the h ^ bb branching ratio. 

When considering the associated channels, beside the reduction in the two-photon 
branching ratio, a further, even though slight, reduction factors affects tih production 
while we expect Wh to be much less affected. This is borne out by the numerical analysis 
shown in Fig. Once again we define, for the associated productions, ratios normalized 
to the SJ^ rates for the same Higgs mass: 

_ a^^^'^jpp ^ Wh) X Ei?^^^^(/i ^ 77) 
^M^77 - ^sM(^pp ^ X BRS^'^ih ^ 77) ^ ^ ^ 

and similarly for the associated top production: Rtt-y-y- At the level of the cross sections, 
a{pp — > Wh, Zh,tih), the ratios are assumed to be given by the ratios of the squares 
of the WWh and tth couplings. We clearly see. Figs. |^-|^, that a lowering of Ma in 
case of no mixing not only results in a lowering of rrih but also in a reduction of both the 
inclusive and associated two photon channels, as compared to the SA4 signal for the same 
rrih- The worst hit channels are the direct production and the tih. The Wh channel is 
slightly less affected. Note that ^^77 vs Rgg-y-y shows almost no tan (3 dependence. Fig. ||. 
This is due to the dominance of the top loop in the gg ^ h production, controlled by 
the same vertex that enters the associated tth cross section. These reductions occur for 
the lightest Higgs mass and are due essentially to the drop in the branching ratio of the 
Higgs into two photons, see Figs. Since as we pointed earlier the significances in the 
associated channels are rather flat with respect to the Higgs mass in the range we are 
interested in, this explains why the 5a discovery region based on the associated channel in 



^In this discussion this apphes especiaUy to the ofF-diagonal terms of the Higgs mass matrix. 
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Figure 3: Variation of Rgg^^ vs Rwyy-Rtt-y-y with 200 < Ma < 1000 GeF and tan/3 = 
2.5{fuU),lO{dotted). 



the Ma — tan/3 plane |Tl|, |T3[ are almost independent of tan/3 (2.5 < tan/3 < 10). On the 
other hand the discovery region based on the inclusive channel shows a strong difference 
between low and high tan (3 values. This is due essentially to the low significances for low 
Higgs masses which translates into low significances for tan (3 in case of no mixing for a 
fixed value of Ma- Therefore although the reduction due to a low Ma is slightly worse 
for tan/3 = 10 than for tan/3 = 2.5, Fig. [l|, the significance in the direct channel is much 
better for tan/3 = 10 {nih ~ llOGeV) for tan/3 = 2.5 (m^j ~ 93GeV). This observation 
is to be kept in mind and shows the importance of localising where in terms of irih any 
reduction, especially, in the inclusive direct channels occurs. Take for instance the CMS 



analysis|13|. It is found that already with a low luminosity of 30fb~^ the significance 
for the SM. Higgs is larger in the associated channel than in the inclusive channel for 
TTih < 105GeV and is above 5. Translated to Class-H this means that for Ma > 450GeV 
associated production allows observability of the light Higgs for all values tan /3 = 2.5 — 10 
whereas direct production extends the reach in Ma for tan/3 = 10 {Ma ~ 400GeV). With 
a higher luminosity of lOOfb^^, the CMS analysis shows that the reach in Ma is better 
in the associated channel for all values of tan/? and especially for low tan/3. In terms 
of the ratio i?^^, this analysis translates into discovery for R^^ > .4 corresponding to 
Ma > 220GeV (even slightly better for tan/3 = 2.5, see Fig. Note that one can recover 
the obsvervability region of the SUSY Higgs of the CMS analysis by combining our results 
for the ratios R with their analysis for the SAi. As stated earlier the ATLAS |]T^ analysis 
requires higher luminosities and the above numbers correspond roughly to a luminosity 
of 300fb~^ to take full advantage of the associated production]^. 



3 Mixing in the stop sector 

To discuss the stop sector and define our conventions, we turn to the weak eigenstate 
basis where the mass matrix in the tL,tfi involves the SUSY soft-breaking masses: the 
common SU{2) mass rfig^ and the U{1) mass ^fj^^-, beside the mixing, 



= rhl^+rnl + -Ml{l--sm^ew)cos{2P) (3.13) 
2 

"^L = m^^^^ + + -M| sin^ cos(2/?) 

= -^*(^* + = (3.14) 



^For lower luminosities the ATLAS significances in the associated channels are based on a Poisson 
statistics. We thank Guillaume Eynard for providing us with his code and the "data" for the SM Higgs 
in the separate channels Wh/Zh and tth^ see also p2]. 



One sees that apart from the soft SUSY-breaking parameters: ?77,q^, 'fhfj^^ and the 
tri-hnear top term {At), there appears also the ubiquitous tan/5 and the higgsino mass 
term fi. 

The stop mass eigenstates are defined through the mixing angle 6*^, with the lightest 
stop, ti, 

ti = coiiOitL + smOitji (3.15) 
It is quite useful to express the mixing angle as [I 



-2m/ A 2 m? 

tan(2^i) = ^ or sin(2gf) = , (3.16) 

^Qa Usr ^ 2 3 ) ti t2 

For further reference note, in the case of equal soft SUSY breaking masses for the left 
and right sector of the stop ( m^^ = m^_^^), that apart from the case of extremely small 
mixing At = O{Mz/10), one has maximal mixing: sin(2%) ~ 1. In this case we have 



mt 12Attanp'' + l 

tan 20,- ~ -TT^^Ti ^2 — 7 3.17 

Mz Mz tan p'^ — 1 

3.1 The titih vertex 

Mixing in the stop sector not only allows one of the stops to be rather light, but this light 
stop can have rather large Yukawa couplings. Let us therefore discuss this coupling. The 
stop-stop Higgs couplings, like the stop mass matrix, emerge essentially from the F-terms 
in the scalar potential (there is a residual D term component oc M|). With the angle a 
in the Higgs mixing matrix, the titih coupling is (we write the potential) 



titih 



+ 



-9 



nit cos a 
Miy sin (3 



(At — yutana) sin^,- cos6'j — rrit 



M| sin (3 
rrit cos a 



■ sm a 



12 2 

- - - sin^ Ow) cos^ e-t + - sin^ Ow sin^ Oi 



(3.1^ 



The vertex does involve some important parameters which stem from the Higgs sector, 
notably the angle a. In the decoupling limit |r7| which we are most interested in and up 
to radiative corrections Eq. ^.18| writes 



2 X mt /i r 

m| 

tan/5 



+ M|((2 + r) cos' - 1) ((^ - ^ si^' ^f^) ^^s' + I ^i^' ^i^' ^t) } 

(3.19) 

We see that in the hmit r <^ 1 where r is neglected, the titih very much simphfies. Note 
that neglecting the correction due to r, the coupling no longer depends on /i. Notice also 
that Eq. p.l9| shows that this correction is reduced as tan P gets larger. Discarding the r 



correction altogether, we end up with a compact formula 



9 (.■.^2ina. ^'^h-^V , _2 
4 



+ M| cos(2/3) {{- - - sin' Qw) cos' Oi + - sin' sin' Oijj (3.20) 

We also confirm that the tan /3 dependence in the vertex is also hardly noticeable. 
Eq. ^.20| makes it clear that even for maximal mixing, sin' 26i ~ 1 the contribution of the 



stops and that of the top cancel each other thus leading to a very small vertex. The dip 
occurs for values of the mixing angle such that: 

sin'2g,-^ , (3.21) 

rrif — mj 

On the other hand when the mixing is negligible, the vertex is accounted for almost 
entirely by the top mass and therefore has the same strength as the tth vertex. 

The ^2^2^ vertex can be obtained from titih by sin6'j ^ cos^^ and m^^ m^-^. There- 
fore if the ^2^2^ and iiiih vertices were to be added, the mixing terms do not survive, 
as expected since the latter mix the left and right states. This is to be kept in mind. 
In situations where the stop masses are of the order of the top mass so that they both 
contribute to h —>■ gg ot h 77, the effect of mixing will, to a large extent, be washed 
away. 

Already at this point we can attempt to predict the general features in Rgg^yy and 
R^-y that will be introduced by large mixing in the stop sector. Consider the large M4 
limit where the titih vertex is most transparent, see Eq. |3.20| . Naturally the stop will 



contribute if its mass is not too large and if its coupling to the Higgs is also large. When 
there is no mixing, only the diagonal m' term in Eq. p.20| will, in both r{h ^ gg) and 



r{h —* 77), interfere constructively with the top quark contribution. We therefore expect 



an enhancement of r{h —>■ gg), that is of the inclusive production. On the other hand, 
the fact that the top/stop loops and W interfere destructively, means that T{h — > 77) 
will get smaller. Nonetheless since the W loop is much larger than the top loop, the 
reduction in the two-photon decay width will be modest compared to the enhancement 
in the two gluon width. Considering that at large the width into bb (thus the total 
width) is hardly affected by mixing and hence sensibly the same as in the SAi, direct 
production a{pp —>■ h —>■ 77) is enhanced. At the same time associated Wh/Zh and 
tih with the subsequent two-photon decay of the Higgs will be reduced somehow. For 
moderate mixing the titih vertex gets vanishingly small: here no effect is to be expected, 
either in any of the associated productions nor in the direct production. When the mixing 
gets very large so that now, it is the term in m?^ in Eq. p.20 which dominates, the sign of 



the interferences between the stop and the top quark loop gets reversed. In this situation 
direct production can get extremely small, the stop loop cancelling the top loop. In the 
two photon decay, on the other hand when this cancellation takes place it still leaves 
the large W contribution. Nonetheless, the increase in R^^ will be modest compared to 
the dramatic decrease in Rgg^^- Since the total width is hardly affected by these mixing 
effects the direct inclusive production will be much reduced. However associated Wh/Zh 
and tih gets enhanced in these situations. 

3.2 pp iiilh at the LHC 

Because ii is relatively light and its coupling to the Higgs (h) large, associated stop cross 
sections can, exceptionally, be of the order of that of the associated top cross section pi 



or 



even larger. At the LHC this cross section is essentially induced by gluon gluon fusion and 
is therefore directly proportional to the square of the titih vertex. We have recalculated 



this cross section with the help of a modified version of CompHep||3^ to properly take into 
account the radiative corrections to the Higgs mass and couplings. For our analysis we 
have found it useful to calculate the cross section at the LHC by taking, as a reference 



point, the mf term only in the titih vertex, Eq. |3.20| . The cross section can then be 
easily evaluated by specifying as independent input parameters m^^ and m/j only. The 
corresponding cross sections are shown in Fig. ^ and Fig. |^. We have made a polynomial 
fit, in the variables rrih — to these cross sections that reproduces the full results with 
a precision better than 2%, which is well within the uncertainty due to the choice of 
scale and structure function. Once a set of SUSY parameters is given, apart from the 
stop masses and tan/5 it will also furnish the corresponding Higgs mass, rrih, and the 
proper titih vertex can be evaluated. One can then properly normalise our cross sections. 
Considering the relative complexity of the pp —>■ titih cross section this method is much 
more efficient when we are scanning over many SUSY parameters as done in the present 



analysis since we do not have to recalculate the pp titih for each scan. Our results 
agree with those shown in as well as in |^ , however the largest cross sections shown 
in ||2^ do not pass our constraint on the Higgs mass rrih > 90GeV and/or Ap (see below). 



3.3 The t2tih, A, H vertex and t2 hh, H, A 



The tit2h vertex may be cast into 




) 



(3.22) 



It is crucial to note that within the approximation of neglecting the r terms and the 
D-terms, this coupling does not survive in the maximal mixing scenario, it is proportional 
to sin(4^j). Nonetheless because of it its Yukawa nature this can be a rather large cou- 
pling and therefore phase-space allowing Br{t2 —>■ tih) can be large. Considering that 
t2 pair production exceeds Ipb for m^-^ < SOOGeV (See Fig. |^), t2 can trigger Higgs (h) 
production!]. 

Contrary to X2 ~^ Xi^ whose branching ratio can reach 100% for some of the SUSY 
parameters [|T3| and thus very efficiently triggers Higgs production, Br{t2 — * ti/i)|]TB| can 
never reach 100%. This is because, independently of other decay modes into the 6, h sector, 
there is always the competing larger decay rate ^2 t\Z . Indeed when the splitting is 
large t2 t\Z can be approximated by ^2 ii'P^-, 4'^ being the neutral Goldstone Boson, 
with an effective coupling sm29f (m| — m? ) = g/2MiYmt{At + /i/ tan/?). 

When Ma is small, t2 can also provide a welcome source of pseudo-scalar (and heavy 
Higgses) through ^2 ii^, H. What's more, the strength of the ^2 coupling does 

not depend on the stop mixing angle: 



The decay t2 tiH is generally smaller and vanishes when the mixing is maximal. 
In the decoupling limit this becomes: 




(3.23) 




(3.24) 



''?if2 is completely negligible at the LHCpOf. 
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Figure 4: titih at the LHC as a function of mi_^ and for a range of SUSY Higgs masses. 
The titih vertex is set in the limit of large with no mixing and no D-term, see text of 
how to normalise it when the SUSY parameters are fixed. Also shown is titiZ . For the 
latter the vertex has been computed with cos^ 6i = 1/2, i.e. maximal mixing. For other 
values of the mixing, rescale by using the vertex — 2/3s^). We have taken the 

CTEQ4 structure function with a scale set at the invariant mass of the subprocess. 
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Figure 5: As in Figure ^ but as function of the Higgs mass. The tih is also shown for 
comparison for the same set of structure functions and by only taking into account the 
gluon gluon processes. For the latter including the small quark initiated process, our results 



agree with j^/ . Also shown is ttZ. 




Figure 6: Next-to-leading order ti pair production at the LHC, for three representative 
values of the gluino mass. We used the code given to us by Michael Spira^^. 



Of course to calculate the branching ratios of t2 into Higgses we have evaluated all 
possible widths of ^2, without QCD corrections though. We have checked our numbers 



against those of |^ as well as the output of GRACE |^T|]. For a general recent review of stop 
decays see Q . For further reference note that whenever stop mixing is not excessively 
small, we can reach Br{t2 tih) ~ 10%. Associated t2tiA in mSUGRA has also been 
entertained recently |^^. However in the mSUGRA scenario the mixing is generally not 
large and the stops are usually heavy leading to small cross section for Higgs production 
through stops. But then in this same scenario large drops in the inclusive production due 
to stop mixing hardly occur either. 

3.4 Constraints from low Higgs masses, and CCB 

Large values of the titih vertex which lead to the largest pp titih and the sharpest 
drop in Rgg-yy occur when the mixing is large with a large splitting between the two stop 
physical masses. It is, however, for this configuration that one has some strong constraints 
which preclude the highest values of the cross section. For instance, one has to be wary 
that imposing a lower bound on the Higgs mass, from its non observation at LEP2 say, 
can restrict drastically the sin 26^ — m^^ parameter space. This constraint is very much 
dependent on tan/5. Much less dependent on tan/? but a quite powerful one, for the 
values of m^-^ that we have entertained, is the constraint coming from Ap|^3[|. Taking the 
present limit Ap < .0013 applicable to New Physics with a light Higgs[@, which here 
means essentially the contribution from stops and sbottoms (and marginally the Higgs 
sector^ ) generally excludes region of the parameter space where the titih is largest. In 
our Ap constraint we have relied on the two- loop calculation of [|^, which can enhance 
Ap by as much as 10% even with a heavy gluino. 

One more constraint one needs to mention. In the stop sector and in the presence of 
large mixing as is the case here, one often has to check whether the parameters do not 
induce colour and charge breaking global minima (CCB)[^. It has been argued that the 



constraints based on the global minima may be too restrictive]^^. It was shown that for 
a wide range of parameters, the global CCB minimum becomes irrelevant on the ground 
that the time required to reach the lowest energy state exceeds the present age of the 
universe. Taking the tunneling rate into account results in a milder constraint which may 
be approximated by : 



A',+3f i' < 7.5(M?^ + Ml) (3.25) 

^For light stops in the decouphng limit the sbottom-stop contribution when substantial gives a positive 
contribution, whereas the Higgs sector contributes a negligible negative contribution. 



When presenting our results we will, unless otherwise stated, impose the limits rrih > 
90GeV, Ap < .0013 together with the mild CCB constraint Eq. |3.25| . Considering that 



the CCB constraint is rather uncertain, it is worth pointing out that our CCB constraint 
hardly precludes points which are not already rejected by Ap and rrih. 

Apart from the indirect constraints we also imposed, the model independent limit. 



mi^^mi^ > 80GeV from present direct searches|^8|. Our limit on the stop, is however 
superseded by our constraint that the lightest neutralino is the LSP and that ti —>■ cXi[4S 
is always open. When taking /i = —M2 = 250GeV with the unification condition, Xi — 
120GeV and thus m^-^ > 120GeV. 

3.5 tan/3 = 2.5 

We start our analysis by considering the case with tan/5 = 2.5. Although this value is not 
far from being excluded by the direct LEP2 searches]^, depending on the exact SUSY 
parameters, we study it here in order to compare our results with those in]^ and to show 
a feature which is not present for higher values of tan /3. 

3.5.1 The case of a common mass in the third generation squark sector 

We first revisit the case]^, ^ of allowing, at the electroweak scale, a common mass for all 
the supersymmetric masses of the third generation squarks: = ^fy^j^ = ^Dsr ~ ^3- 
Taking a common value for the SU(2) and U(l) masses shows that unless the effective 
tri-linear term is negligible. At ~ 0, this leads to | sin 26*^1 = 1, see Eq. |3.16| . We note 
that contrary to what is claimed inQ this situation, although common for the first two 
generation of squarks, occurs only in exceptional situations in a model such as mSUGRA. 
Moreover in mSUGRA At is controlled almost entirely by mi/2, the common gaugino 
mass, and thus would not be excessively large []50|. Leaving this aside, this assumption 



helps keep the number of parameters to a minimum while concentrating on the impact 
of mixing. To that effect we have set, apart from the common third family scalar quark 
TTig which was allowed to vary in the range 100 — lOOOGeV and Ma = ITeV, all other 
sfermion masses to SOOGeV. Moreover we have assumed the unification condition for the 
gaugino masses and set the Higgsino mass M2 = — p = 250GeV. We then scanned over At, 
— 1000 < At/{GeV) < 1000 and m^. Note that since we are scanning over both positive 
and negative values of At, some important mixing effects sensitive to the sign of At x fi 
are covered even though we have fixed the sign of /x. Among the 2.10^ generated point 
for each tan f3 half passed all the constraints. 

First as shown in Fig. |^, we do confirm that the reduction in the two-photon signal 
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Figure 7: Rgg-y-y vs mi^ for tan/3 = 2.5, /i = —250(76^ and Ma = ITeV. 



in the direct channel is most dramatic for the lowest values of the stop mass, although 
a low stop mass does not always mean that a reduction has to occur. As a matter of 
fact there are more points that generates a low m^^ and give Rgg-y-y > .6, say, than those 
that give Rgg-y-y < -6. Note that most points clustering around values corresponding to 
little mixing or large stop masses. Therefore the very rare situations corresponding to 
very sharp drops could be interpreted as at best unnatural. It is also worth pointing out 
that values such that Rgg-y-y > 1- are not obtained for tan/? = 2.5. We have verified that 
while, in principle, this was possible for tan/3 = 2.5 this possibility was ruled out by the 
requirement of having rrih > 90GeV. 

As stressed numerous times, for the intermediate mass Higgs in the direct channel decaying 
into two photons, the significance depends crucially on the Higgs mass. It is therefore 
important to localise for which values of the Higgs mass, the reductions are most drastic. 
For tan/? = 2.5 we see. Fig. ^, that this reduction gets worse, Rgg-y-y — .2 for Higgs masses 
clustered around ~ lOSGeV. 

It is important to note, on the other hand, that for Higgs masses around 90GeV 
where the [SAi ) Higgs signal is most difficult to extract, the effect of the stop is rather 
negligible (here there is no mixing hence the low mass of the Higgs which does not get 
further radiative corrections). Therefore this is a welcome point. As compared to the case 
of CLASS-H with Ma = ISOGeV and tan/3 = 2.5, for which Mh = 90GeV, Rgg^^ reaches 
.3 whereas for the same Higgs mass (and tan/?) our points cluster around one. An even 
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Figure 8: As in Fig. ^ but for a) Rgg-y-y vs M^, h) Rgg-y-y vs Rjj and c) R^j vs M/j. 



more important remark concerns the behaviour of the branching ratio into two photons. 
We find, see Fig. ^, that the branching ratio into photons in this SUSY scenario increases 
at the same time as the direct production decreases, in sharp contrast to what happens 
in CLASS-H when Ma decreases. This confirms our expectations. The Rgg^^y vs R^^ can 
be considered as a signature of this scenario. In the corresponding scatter plot of Fig. |^, 
the points fall almost along a line and shows that when Rgg^yy < .8, R^^ > 1. Considering 
that in this large Ma scenario and even in the presence of large mixing the tth and Wh 
are sensibly the same as in the standard model, the associated Higgs production with 
the Higgs decaying into two-photon should pose no problem with the high luminosity 
LHC We do not show the ratios for ^77 and 1^77 as these are given essentially by the 
ratio R^^, see Fig. ^ . To conclude, for this value of tan/3 = 2.5, when 90 < rrih < 100 
observability of the lightest SUSY Higgs (h) is quite similar to that of the SAi. Above 
these values, if the direct production is not possible, the branching into photons is larger 
than the SAi and thus associated production provides more chance of detecting the Higgs. 
For instance, taking the SAi Higgs CMS analysis[jl3[ with a luminosity of lOOfb"^ as a 
guide, shows that it is only in the range 100 — 105 where values below .6 are possible for 
Rgg-yy that the Hlggs may not be observed in the direct channel. The same analysis shows, 
however, that with the values that we obtain in the associated channels that there is no 
problem of cornering the Higgs. Note that for the most critical drop in the direct channel 
we have obtained a enhancement factor of up to 1.35 in the associated production. For 
such values even the ATLAS simulation with a luminosity of lOOfb"^ indicates 
observation in the associated channels. 
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Figure 9: As in Fig. but for Rgg^^ vs a{titih)(fh) 



Finally, another note of optimism in the case where the drop in the inclusive production 
is severe is that production of h in association with stops could help also. As shown in 
Fig. 1^, whenever Rgg^yy < .6, a{titih) is in excess of lOOfb and can reach as much as 
~ 740fb. As a comparison, for these extreme cases for which rrih ~ 100 — lOSGeV, one 
has a{tth) ~ 500fb. Considering that, see Fig. [^, these helpful tii\h cross sections are for 
values of m^^ < 250GeV for which Rgg^yy < .6, ti with our choice of parameters will decay 
exclusively into cXi- It remains to be seen whether this constitutes a viable signal and 
whether we could use the Higgs decays into bb, which by the way is not much affected at 
these low values tan/5 by these mixing effects. The signal would be bb + jets + ^t- Note 
that the continuum titiZ is quite small. For m^^ = 120GeV and maximal stop mixing 
angle, after folding with Br{Z bb) the continuum leads to a dismal raw cross section 
of about Ifb. 



3.5.2 Lifting the degeneracy in the third family scalar masses 

We have already argued that the scenario with exactly equal squark masses for the third 
generation is very special and even unnatural. Taking a more general framework, we 
move away from the case of maximal mixing. As we have discussed this can open up new 
possibihties, notably 12 ^ iih decays. For illustration, we have taken m^-^^ = 200GeV, 
^~km ~ SOOGeV and allowed 50 < rrig^ < SOOGeV. In order to compensate for the 
deviation from maximal mixing, the trilinear coupling was allowed to vary in the range 
—2000 < At < 2000GeV. However very few points with > 1200 pass our constraints, 
essentially from Ap. As expected the general features found in the case of maximal mixing 
are still present here, even though with our parameters the drops are not as dramatic as 
in the maximal mixing case. Another observation is that irih > lOSGeV is not generated. 
This is because contrary to the previous case the stop masses do not extend to ITeV and 
hence the radiative corrections to the Higgs mass are not optimal. Nonetheless as seen in 



Fig. a ratio Rgg-y-y as low as .4 is possible and occurs for low ti masses. Again this drop 
occurs for a small range of Higgs masses sensibly the same as in the maximal mixing case, 
rrih ~ 103 — 104GeV, Fig. llOl However when this occurs one is saved by the fact that the 



branching ratio into photons is larger than in the SAi, Fig. |TT|. Moreover we still find 
that when Rgg^yy gets too small pp —>■ tit\h is of the order lOOfb reaching a maximum of 
200fb when Rgg-y-y is lowest. Fig. |1^. The main novelty here is pp —>■ ^2^2 ~^ ^2^1^? with 
Br{t2 tih) = (9(10%). Because this stems from a two-body cross section, it can lead to 
quite large a{t2t\h) reaching as much 600fb, and therefore in many instances larger than 



the continuum tit\h^ Fig. |T2|. What is also worth noting is that these large cross sections 
do not necessarily occur when one has large drops in the inclusive two-photon channel. 
Moreover the signature in this channel should be cleaner, taking advantage of the cascade 



decays of the other t2 starting with tiZ,hiW,hxi2i ■■■■ Of course there are points where 
neither ^2^1^ nor iiiih exceeds 10fb,Fig. [1^. However in this case the reduction in Rgg-y-y 
is quite modest. 





1 .4 


?^ 




t 


1 .2 




1 




0.8 


t 


0.6 








0.4 


□:: 






0.2 



tan/? = 2.5,AA=-250GeV,M,= 1000GeV 
M„,=200GeV,M,=500GeV, IA,l<2000GeV 




100 200 300 400 500 600 700 800 900 1000 

mu(GeV) 





1 .4 






t 


1 .2 
1 


t 


0.8 


CD 






0.6 


cr 


0.4 




0.2 



90 



tan^ = 2.5,Ai=-250GeV.M;^= 1 OOOGeV 




95 



100 



105 



110 



115 



120 125 

M,(GeV) 



Figure vs mi_^ for tan/3 = 2.5, /i = — 250(76 F and Ma = ITeV, when we 

allow different scalar masses for the third generation as given, see text . b) As in a) but 
for Rgg^y vs Mh- 



N 1.4 
/j^ 1.2 



^ 1.6 

^- 1.4 

1.2 
CS 1 
0.8 
0.6 
0.4 
0.2 



tan^ = 2.5,/x=-250GeV,M;^= 1 OOOGeV 
M„,=200GeV,M,=500GeV, IAJ<2000GeV 




4 


tan^ = 2.5,M=-250GeV,M;,= 1 OOOGeV 


" 1 1 1 1 1 1 





90 95 100 105 110 115 120 125 

M,(GeV) 



Figure 11: As in Fig. [7^ but for Rgg^^-y vs R.^^ and R^^ vs . 
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Figure 12: As in Fig. |7| but for a) Rgg-y-y vs a{pp tiiih), b) Rgg^^ vs a{pp ^2^1^) 
and c) (t{pp — titih) vs a{pp t2tih). a{pp — ^ t2tih) = a{pp t2t\h + t^^tih) 
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Figure 13: a) Rgg-yy vs for tan/5 = 2.5, ;U = — 250GeV and Ma = 350GeV, with equal 
squark masses, b) As in a) but for R^^ vs M^. c) As in a) but for Rgg^y^y vs R^^. 



3.5.3 Stop mixing with a low Ma 



We have seen in section 2, in the case of no- mixing, that as Ma decreases both the 
inclusive and associated two-photon channels decrease, mainly because of an increase in 
the width into hh which dominates the total width and hence reduces the two-photon 
branching ratio. Since hhh is hardly affected by the mixing effect, this decrease due to 
Ma will also be present in the case of mixing and hence reduces the significance of the 
two-photon channel. This overall reduction, independent of mixing, can be evaluated by 
using Eq. |2.1CI| . Likewise since the titih vertex carries the same reduction R as the tih 
vertex, see Eq. p.l9| , an overall Ma- reduction in Rgg-yy, which can be approximated by 
Eq. |2.11| , will take effect beside the pure large stop mixing effects that we have discussed 
in the Ma = ITeV limit. We first consider the case of a moderate M4 = 350GeV with all 



other masses as in section 3.5.1. Figs. show that those points for which at large M4 the 
effect of mixing were most drastic on -R3377 are not much further reduced. They occur for 
masses which are sensibly the same as with the much larger Ma- Note however that the 
optimal values of Rgg-y-y are reduced from about 1 to .8 and occur also for M^ ~ 90GeV. 
This reduction is essentially what we would have obtained by applying the factor Rgg-y-y 
calculated using Eq. For this value of M^ now detectability may be a problem 

if the luminosity is low, especially that the corresponding R^^ is about .75, which may 
also preclude detection in the associated Higgs production. Figs. With these values 
occuring at such low values of rrih, even CMS[|13[ with 30/6~^ will miss the Higgs, but 
again there should be no problem in the associated production after collecting ~ 100/6~^. 
Still, whenever mixing becomes important and reduces Rgg-y-y significantly, associated 
production should be no problem. For instance when Rgg^.y is below .4, R^^ > .95. In 
these configurations Br{h 77) benefits from the increase in r{h 77) which is not 
completely offset by the increase in r{h bb). In these configurations with small ti, titih 
could help with a{iiiih) = 100 - 780fb, Fig. 0. 

We may argue that had we taken a much lower value of M4 we would have introduced 
a larger reduction in R^^ which may affect dangerously the associated production. We 
would then be in a situation where the inclusive cross section is down because of large 
mixing in the stops and the associated production small mainly because the branching 
into photons is down as a result of Ma being low. Note however that in these situations 
we would be far from the decoupling regime, with all Higgses being relatively light and 
a very light stop having large couplings to the Higgses. One consequence of this light 
spectrum is that, even in the case of maximal stop mixing where t2 ^ tih is inhibited. 



®With our set of parameters one would expect that some points with maximal mixing are generated. 
However we have checked that these do not pass all the constraints. This explains why we never get a 
vanishingly small t2tih cross section. 
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Figure 14: As in Fig. but for Rgg^j vs a{pp titih) . 



the tit2A coupling is large, Eq. p.23 and can be such that it triggers ^2 tiA. This is 



because large mixing and large splitting between the stop, allows enough phase space for 
a relatively light pseudo-scalar. To illustrate this fact, we have lowered Ma to 250GeV. 
The gross features found for Ma = 350GeV are still present as concerns the inclusive 



production of h Fig. 15, with an overall reduction factor due to Br(h — > 77) which is 
slightly larger. At the same time the location of the drops are shifted to slightly lower 
values of m/j, which is a direct consequence of a low Ma- However as shown in Fig. |T^, 
a{t2iiA) can be quite large and often exceeds tiiih. Note that a{t2i\A) may be large 
even for points where the inclusive two-photon cross section is lowest, whereas t2t\h is 
largest for regions where the inclusive cross section is most affected. Therefore we see that 
combining different channels in this scenario offers much better prospects than in the no- 
mixing case with the same low value of Ma- To start with, when the direct production 
is very much reduced, associated production has a better siginificance in the case of very 
large stop mixing compared to the no mixing case for the same Ma- Another interesting 
point is that although the main decay of A will be into 66, we also find that A —>■ Zh 
can be substantial. For instance, the chain a{pp t2^2 ^2^1^ —>■ t2tiZh) can reach as 
much as 350fb (for this point m^^ = 129GeV, m^^ = 396GeV). For larger values of the stop 
masses (m^^ = 235GeV, = 525GeV), the same chain corresponds to 43fb. The decay 
t2 iiH is also possible, but the corresponding cross section, (T{t2i\H) is below lOfb. 
This is because the branching ratio into H is about a factor cos^ 29i down compared to 
the branching ratio into A, while H and A are almost degenerate in mass, Eqs. |3.24| - 13.23| . 
To end this section let us mention that when the mass of the pseudo-scalar gets small. 
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Figure 15: a) R.^^ vs for tan/? = 2.5, /i = —250 and Ma = 250TeV, with equal squark 
masses, b) As in a) but for Rgg-y-y vs R^^ 



below 2mt, one should also investigate direct gg ^ A, H production. A low mass ti has 
no effect either the production or decay (we are in scenario where m^^ > ^a) of A, the 
usual channels should not be much affected. For H, one needs to critically review how 
the production is affected and whether H —>■ titi can be exploited. The phenomenology 
is certainly richer here and the Higgs(es) should not be missed. 



3.6 tan = 5 

We now move to a larger tan (3. We go through basically the same steps as those in the 
previous section, 3.5. For the same scenarios we will scan over the same mass ranges. 
One general new feature will have to do with the fact that for larger tan (3 we obviously 
have larger Higgs masses. In most cases this will help. However on the whole similar 
conclusions will be reached. 



3.6.1 The case of a common mass in the third generation squark sector with 
large Ma 



Again Rgg-yy IS most affected when the ti mass is smallest, Fig. |T^. In the maximal mixing 
case, one new feature compared to tan/5 = 2.5 is that the ratio Rgg-y-y can be larger than 
one, for small m^^, reaching almost ~ 1.3. This is even more welcome that it occurs for 



Higgs masses in the range 92 — 98GeV, Fig. As a matter of fact, this is consistent with 



the argument we gave earlier: in this case ^2 is not too heavy so that the top and ti loop 
interfere and since the scale in the stop sector is not too high, the radiative corrections to 
the lightest Higgs mass are far from maximal. Considering that, especially in the lower 
end of this range, the significance in the direct channel are usually [SAi or no-mixing) 
smallest, such scenarios can make it easier to discover h even in the direct channel. Of 
course, light ti (with much heavier ^2) can also lead to a much reduced Rgg-yy- When this 
happens it occurs for higher Higgs masses, clustered around Mh = 115GeV. Though for 
this range of rrih significances in the direct production are much better, for certain values 
of the parameters the drop is too severe: Rgg-yy < .4. But again this occurs simultaneously 
with an enhanced i?^^: i?^^ > 1.2, Fig. |1^. Again the smaller Rgg-yy the larger R^^. As 
with the lower tan/5 when the direct production drops, a{pp — >■ titih) increases. When 
Rgg-y-y < .6 thls cross scctlou is in excess of lOOfb up to ~ 650fb, for the smallest value 



of Rgg-y-y, Fig. |T^. Notc also that when Rgg-y-y > 1 this additional cross section is below 
lOOfb. 
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Figure 16: As in Fig. but for R^^ vs a{titih) and a{t2tiA) 
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Figure 18: a) As in Fig. hut for Rgg-y-y vs R^.y. b) As in a) but for R^^ vs ■ 
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Figure 19: As in Fig. but for R^^ vs a{titih). 



3.6.2 The case of a common mass in the third generation squark sector with 

Ma = 350GeV 



The discussion is essentially the same as the one we presented for tan/5 = 2.5 with 
Ma = 350GeV. The overall reduction factor from the lowering of Ma which affects R.y.y is 
slighty smaller (about .76) but then the reductions in Rgg-y-y are for ~ 115GeV, Fig. pO| . 
Note also that a{titih) production, Fig. ^ is only slightly smaller than with tan (3 = 2.5 
(this is due to a higher Higgs mass) and therefore is a useful addition when the direct 
channel drops too much. For Rgg^^ < .2 one gets as much as 400fb. For larger tan/3 
and small Ma, de-excitation of t2 into ti is not as efficient as for the lower tan/? with the 
rather moderate values of fi that we have considered in this study. This is evident from 
Eq. |3.23| , but as we see titih still plays its role. 



3.6.3 Lifting the degeneracy in the third family scalar masses 



Taking unequal masses as in section 3.5.3, the reductions in the direct production are less 
pronounced. We do not get below Rgg'y-y < .55, while values up to 1.25 are still possible for 
Rgg-y-y- Thcrc Is also little change in where these reductions or enhancements occur as a 
function of the Higgs mass. Again when Rgg-y-y < .8, Ryy > 1, Fig. |22|. As with tan/3 = 2.5 
when the mass degeneracy is lifted, the channel t2 tih opens up. This leads to typical 
cross sections of the order of lOOfb especially for regions where the drop in the direct 



inclusive two-photon channel is the largest, see Fig. 22. This cross section can be larger 



?^ 1.4 

2 



1 



t 

to. 



en 

CT1 0.6 



0.4 



0.2 - 



: tan/5' = 5,A4=-250GeV,M,= 350GeV 






~ 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 





0.2 0.4 0.6 0.8 1 1.2 1.4 1,6 1.8 2 

R(h yy) 



t 

JZ 



2 p- 
1 .8 

1 .6 ^ 
1.4 

1 .2 ^ 
1 

0.8 ^ 
0.6 

0.4 ^ 
0.2 ^ 



tan/S = 5,^=-250GeV,M;j=350GeV 



90 



95 100 105 



10 115 120 125 

Mh(GeV) 



Figure 20: a) As in Fig. hut for Rgg-y-y vs R^.y. b) As in a) but for R^^ vs ■ 
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Figure 21: As in Fig. but for R^^ vs a(titih). 



than Ipb in situation where Rgg-y-y is httle reduced. Of course our scans do show some 
regions where this cross section is unusable, typically when the mixing and stop splitting 
is small, but then as Fig. ^ shows the inclusive two-photon channel is unaffected. Of 
course continuum (7{titlh) is still useful when large drops occurs (it is then around lOOfb) 
but note that for our choice of parameters a{t2t\h) is practically always larger. Fig. ESI. 



3.7 tan/3=10 

Apart from the location, in terms of the Higgs mass, of where the largest drop in Rgg-yy 
occurs, that is around llSGeV, all the general features we found in the case with tan (3 = 5 



are recovered again. Figs. 24. Note that we do not get more noticeable reduction either 



in Rgg-yy OT R-y-y duc to the larger tan/?, and also that Rgg^^ > 1 are possible. Similar 
observations to those made for tan (3 = 5 can be made here even when we consider different 
splitting and lowering of masses, especially as concerns the importance of t2t\h. Some of 
these results are summarised in Figs. |23 . 
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Figure 22: a) Rgg-y-y vs R^^ for tan/3 = 5,/i = — 250GeV and M4 = ITeV, when we allow 
different scalar masses for the third generation as given, see text . b) As in a) but for 
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Figure 23: yls m ^ /or Rgg-y-y vs titih and ^2^1^ ''^s t2^i^ 
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4 Conclusions 



We have in this paper reinvestigated the fate of the photon signal of the hghtest SUSY 
Higgs at the LHC when large tri-linear mixing terms in the stop sector are present. 
Previous investigations]^, || had drawn a very pessimistic picture of these scenarios. Our 
analysis shows that if we exploit all the consequences of these scenarios and not pick out 
only the Higgs signal in the inclusive channel these models have an excellent discovery 
potential. First, the large reductions in the inclusive two-photon signal not only require 
large mixing but also that one of the stops be relatively light. Although this has not been 
stressed in the text, a first signal of these scenarios will be iiil production with a cross 
section of order ~ lOOpb. Even though it may be argued that regions with the largest 
drops in the inclusive two-photon channel correspond to a very light stop and are likely 
to lead to a signature, jets+^T, which is difficult. In any case it should be stressed that a 
hallmark of these scenarios is that whenever the signal in the inclusive channel drops that 
in the associated Wh/Zh and tth channels increases and makes it up for the drop in the 
former channel. Moreover when a{pp —* h 77) gets too small the continuum pp titih 
^ reaches values of order few lOOfb. More importantly we find that since these situations 
imply a large mass splitting between the two stops, t2 ^ tih can be substantial leading 
to another source of Higgs production with a yield larger than in the continuum and 
with a better signature than the titlh continuum. We have shown that ^2 t\h occurs 
whenever the stop mixing angle does not take its maximal value, | sin26'^| = 1, which is 
often unnaturaly assumed on the basis of equal soft SUSY breaking masses for the SU (2) 
and U{1) sfermions of the third generation, at the electroweak scale. We have also shown 
that although when Ma gets small the two-photon signals (both direct and associated) 
get further reduced (this happens even in the absence of mixing), with large tri-linear 
mixing terms and especially for low values of tan /5, one can trigger A production through 
the cascade t2 — > ti^, beside the usual channels for A productions. Moreover one should 
not forget that especially with not too small tan/5, tan/3 > 3, scenarios with light stops 
(but small mixing) do give an increase in the direct channel, but then an decrease in the 
associated two-photon channels. The overall conclusion we can draw almost resembles 
that of a no-lose scenario: whenever an effect reduces a particular signal it opens up 
new channels or enhances other channels. We have not discussed the use of /i — > 66 in 
the associated tih channel which in these scenarios should allow detection. This requires 



rather good 6-tagging facilities, as shown in . This should certainly add to the discovery 
potential. The new associated stop Higgs signatures deserve a full simulation to critically 
quantify how beneficial these additions can be. In general there is a lack of detailed study 
of stop phenomenology at the LHC despite some important theoretical issues related to 



the third generation sfermions. As has been pointed out by several authors |51] the idea 



of an inverted hierarchy of the SUSY spectrum whereby the third generation sfermions 
are, at the electroweak scale, much hghter than the first two is compelhng and quite 
plausible. This helps solve the flavour problem in SUSY since very large masses for the 
superpartners of the first two generations can suppress FCNC, contributions to electric 
dipole moments and lepton flavour violations. This would still not go against naturalness 
since these particles couple weakly to the Higgs, at the heart of the fine-tuning problem. 
Naturalness does on the other hand require the stops and sbottoms (and the electroweak 
gauginos higgsinos) to be rather light, like in the scenarios we have studied and could also 



with a light stop make electroweak baryogenesis|52| work. 
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